Tsinghua University at TRECVID 2004: Shot Boundary Detection and High-level Feature Extraction

Our shot boundary detection system mainly consists of three components: fade out/in(FOI)detector, cut(CUT)detector and gradual transition(GT)detector. The key technique of FOI detector is the recognition of monochrome frame. In CUT detector, second order derivative method is applied to get cut candidates,and then flashlight detector and other gradual transition filter module are incorporated to eliminate false positives. In GT detector, short GT and long GT are treated separately, more specifically,twin comparison algorithm for short GT and finite state automaton (FSA) model for long GT. Ten runs are submitted. And the evaluation result shows that our system is among the best. The characteristics of the runs are summarized as follows. thuai02 Baseline system with default architecture and default parameter settings. thuai05 Second order derivative scheme for short GT. thuai07 Looser conditions for short GT detector. thuai08 Without gradual transition filter module. thuai10 Prolong the duration of post-cut modules,including flashlight detector and gradual transition detector. thuai14 Baseline system Derived from thuai10 with higher coefficients for motion based self-adaptive threshold. thuai15 Even higher coefficients for motion based self-adaptive threshold. thuai16 Increase the higher threshold of FSA model. thuai17 Further heighten the higher threshold of FSA model. thuai19 Replace the second order derivative of CUT detector with first order derivative. In Feature Extraction task, the visual modal detector forms our baseline system. And several kinds of other detectors based on text and timing cue are added. The system is applied to three concepts1, namely: “Basket scored”, “Bill Clinton” and “Beach”. For “Basket scored”, the visual modal detector achieves 0.561 in AP. And the added text and timing information brings 20% increase in AP and arrives the best run for that concept. The submitted runs of “Basket scored” are: B thuai 10 Baseline system. AP-based Borda fusion of results generated by different visual models. B thuai 5 Baseline + commercial filter B thuai 1 Baseline + commercial filter + SRI operation. B thuai 7 Baseline + commercial filter + SRI operation + shot cluster operation.